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scheduled for 4 hours a day* The program was organized around two 
major instructional components., individual and small group reading 
sessions and reading-oriented art work^^ At^ all sites, students 

attended two $0*-minute art workshops per day and were offered a 
variety 0jE visual, plastic, and performing art experiences. In 
addition^ students were pulled out bf the art workshops on a rotating 
basis for 45 minutes of daily, direct reading instruction. Results of 
a quantitative and qualitative assessment of the program indicated 
that the program was highly effective in meeting its proposed goals. 
Kfearly all of the program participants mastered at least one new 
skill in reading and many mastered two or more. Despite some istart*^up 
difficulties and sign if leant problems with transportation, attendance 
wajl exce^^ stiidents were cooperative and eager to learn. Both 

reading and art teachers were enthusiastic about the program and 
cited gains made by students in self ^confidence, socialization, and 
creative expression, as well as their measured improvement in reading 
skills. (HOD) 
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. I: A SUMMARY OF THE EVALUATION . 
OF THE SUMMER 1981 E.S.E.A. 
: I I TITLE I/P.S.E.Ni LEARNING TO READ 
.. r . /I THE ARTS (L.T.R.T.A.) PROGRAM 

.\::f; ■;: yr" '] / ■v^:V;-::: 

The L.T.R.T/A/ summer program was designed to provide supplementary read- 
ing servicef to 3,360 Title I-eligib1e, monolingual and btl ingual handicapped 
children att classes in community schools. Priority 
was given to those mildly- to moderately-impaired Students who were not expec- 
ted to pa^i^iS the fourth- and sevent^^ 

;V ' 

A di |§nostic-prescri pti ve. methodol ogy was used, based on profiles from the 
Fountain|Val ley or the Lfiamos readi ng tests. Readi ng i nstruction was organi- 
zed on t|e pull-out ffiodel with each teacher-paraprofessional team serving a 
total of '40 students. 'Direct reading sessions were integrated with the read- 
ing-oriented art workshops which eonstituted the major portion of the instruc- 
tional day. • 

Results of the quantitative and' qualitative assessment of the 1981 summer 
L.T.R.T.AV program indicated that the program was highly effective In meeting 
its proposed goals. Nei^r" all (91.9 percent) of the program participants 
mastered at least one new^kill in reading and many (62.5 percent) mastered 
two or more. Despite some start-up difficulties and significant problems with 
transportation, attendance was excellent; students were cooperative and eager 
to learn. Both reading and art teachers were enthusiastic about the program 
and cited gains nfade by students in self-confidence, socialization, and crea- 
tive expression, as well as their measured improvement in reading skills. 

Relative to previous summer cycles,' the 1981 program was seen to have made 
improvements in: integration of the reading and arts components; involvement 
by site supervisors; and adequate and timely provision of supplies. However, 
transportation continued to be' problematic. 

Based on the findings, the following recommendations are offered: 

--the estblishment of bus routes and the use of trial runs 
prior to the program; 

—the use of I.E. P. s both for facilitating the setting of 
objectives and also for giving summer teachers informa- 
tion about skills already learned which can be reinforced; 

-*the selection of students for the bilingual component on 
the basis of records of their participation in bilingual 
.pragrams through the school year; " 
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I. INTRODUCTION 

This report Is an evaluation of the E.S.E.A. Title I Learning to Read 
Through the Arts (L.T.R.T.A.) program during its third summer of operation 
L.T.R.T. A. provided supplementary reading' services, incorporated into a 
reading oriented arts program, to 3,360 mildly- to moderately-handicapped 
children in grades -three through nine, most of whom were not expected to 
pass the fourth and seventh grade promotional gates. . 

The efficacy of the L.T.R.T.A. program has been demonstrated in the 
two previous years; in the current program year the major premises and 
design remained the same. . First, summer instruction has been shorn to 
prevent the loss of skills which often occurs for handicapped students 
between spring and fall terms. Second, the program employed the arts as 
a core for learning; artistic activities, in a ran^e of modalities, pro- 
vided the basis for creative expression leading to experiences of suc- 
cess and improved confidence and motivation. -Reading, writing, and lis- 
tening, skil Is were exercised in the context of hon-threatening, divergent 
tasks and, at the same time, the artistic experiences were incorporated 
into direct reading instructloji. 

The program was held in 20 sites throughout the city from July 6 to 
August 7, 1981 and was scheduled for four hours a day, Monday ^through 
Friday. It was administered by the Division of Special Education of the 
New York City Public Schools and directed by a coordinator and two as- 
sistants. Site supervisors, teacher trainers, artist teachers, reading 

o 

teachers* paraprofessionals, student aides, and clerical and security 
staff were present at every site. 



The evaluation of the L.T.R.T.A. program was based on both quanti- 
, tative data on pupil achievement and qualitative data on program im pie- 
mentation. The pegults of pre- and posttest administration of the Foun- 
tain Valley Reading Test or the Leamos Reading Test for Hispanic students 
with limited English proficiency were-recorded on O.E.E.^developed data 
retrieval forms. Iti addition, field consultants visited all of the sites 
twice and completed observation and interview records designed for evalu- 
ation of the L.T.R.T.A. program. 



II. EVALUATION. OF PROGRAM IMPLEMENTATION 

PROGRAM DESCRIPTION ■ ^ ' 

The L.T.R.T.A. summer program was designed to' provide supplementary 
reading services to 3,360 Title I-eligible/ monolingual and bili-ngual 
handicapped children attending special education classes in community ' 
schools. Priolty was given to those mildly- to moderately-impaired stu 
dents who were not expected to pass the fourth- and seventh-grade pro- 
motional gates. 

■ A df agnostic-prescriptive methodology was used based on profiles 
from the Fountain Valley or the Leamos reading tests. Reading instruc- 
tion was organized on the pull-out model with each teacher-paraprofes- 
sional team serving *a total of 40 students. Direct reading sessions were 
integrated with the reading -oriented arts workshops which constituted the 
major portion of the Instructional day. , 

FINDINGS ' 

Instructional -Activities^ Planning, and Assessment ' 

The program was organized around two major instructional components, 
individual and small-group reading sessions and reading -oriented art work 
shops. At all sites, students attended two 90-m1nut6 art workshops per 
day and were offered a variety of visual , plastic, and performing art ex- 
periences. Observed activities included ceramics, photography, music, 
drama, puppetry, and painting. In addition, students were pulled out 
of the art workshops on a rotating basis iFor 46. minutes of daily, direct 



reading Instruction. 

. ClaSs sizes were generally sniall with an average attendance of five 
students. Both tJie reading and art- teachers used a range of instruc- 
tional approaches appropriate to the content of the lesson, with the 
reading sessions individually structured somewhat more often. In about 
one-half of the reading sessions and nearly all of the art workshops the 
teacher was assisted by a paraprofesslonal , student teacher, or student 

aide. 

Reading goals were incorporated Into the arts component in^ a number 
of ways: students read* ^nd followed directions, learned new vocabulary, 
and- wrote and performed scripts.^ In addition, all students kept daily 
journals of their wdrk. In most classrooms, tnaster Journals were also 
in evidence. 

Most of the reading teachers based their reading lessons on the stu- 
dents* arts experiences. This was not always possible as students often 
came from several 'different art warkshops if they had been grouped for 
reading an the basis of their reading levels. However, when students 
fro(n the same art workshop were pulled out for reading together, some 
teachers stated that they found It difficult to plan for the range of 
reading abilities represented. 

Students' folders were generally maintained by the reading teachers 
and contained up-to-date' test results. Individualized reading objectives, 
and samples of student work. In many cases folders also Included indi- 
vidualized educational plans (I.E.P.s) and suggest Ions for the regular 
school year^'plassrooni teachers. Weekly lesson plans for both art and 
reading sessions were usually kept by the teacher-trainers. Most teachers 



found the Fountain Valley Reading Test suitablefor their students and used 
"it for Indiylduali zed planning. However, some teachers found it inap* 

proprlate for certain students or for a summer program. Many suggested 
'the I.E.P.s would be a more productive basis for individualized planning. 

Physical Setting, Equipment, and Supplies •. 

The classrooms for both reading and art were generally appropriate 
and/wdll -organized. Student work, both artistic and written, instruc- 
tional objectives^ and project-related materials were displayed, and sup- 
plies were readily available. 

All of the art workshops and .most of the reading classes were ad- 
equately suppl ied with materials and equipment. In a few reading classes, 
supplies were insufficient or delayed. 

0rientati6n> Supervislont and Staff Communication 

Most"^ of the teachers expressed a need for modification of pre-servlce 
training. 'They reported that there were too many people involved or that 
it was appropriate only for the less experienced teachers. Many felt there 
was not enough emphasis on demonstration of technique and several art teachers 
complained of being trained for one v7orkshop and assigned to another. 

On-site supervision, in contrast, was quite favorably regarded. Super- 
visors and teacher trainers were seen as competent and experienced and 
teachers frequently remarked that they felt free to bring up any program 
issues with them. 

Many of those interviewed indicated ^a need for more communication 
between reading and arts teachers. They felt that one hour per week 



was Insufficient for effective coordination of the two program elements. 

Administration * . 

Delays in planning contributed to" a number of problems for the pro- • 

gram. Teachers were assigned only shortly before the program began, 

^ ' .'■ ■ - - 

giving them little time for preparation. Student registration, on the 

other hand, was generally completed wel 1 in advance. However, there was 

no fdl low-up and parents were not notified of the exact schedule^| site 

for some time. Many families made other -plans which necesstta^ Icist- 

minute recruitinf of other students. 

Planning problems were particularly evident in the bilingual compon-' 
ent of the program. A§ originally proposed, one Spanish-speaking reading 
teacher was to be assigned to each site. However, in Manhattan, Queens, 
and Staten Island, there were no bilingual teachers and in the remaining 
two boroughs, some bilingual reading teachers were assigned several to 
a site and others taught in the art workshops. Pupil assignment was also 
a problem, with students being selected for the bilingual component on 
the basis of their having Spanish surnames. Another difficulty was the 
late arrival of the Leamos testing materials, in some cases up to two 
weeks into the program. Most teachers reported that they had already 
tested their students with the Fountain Valley and were reluctant to 
administer another test so late into the program. As a result, Leamos 
was only used with, the roughly 30 students who spoke Spanish exclusive- 
ly.' ■■ •; • / 

As with previous program cycles, difficulties with busing constituted 

'a pervasive problem. Frequent, unannounced scheduling changes and num- 



erous Instances of fall Ing to pick up children were reported, both of which 
'apparently contributed to student attrition. ■ 

Program Impact 

The majority of teachers In the L.T.R.T. A. prtjg ram were enthusiastic 
I^OMt the overall design and impact and saw the program as highly ef- 
fective. Individualized attention, the non-threatening atniosphere of 
the art workshops, and the Integration of the'reading and art cdfipon- 
ents were all cited as contributing to program success. In py^kularj 
teachers reported that at first children were often reluctant to'leave '' 
the art workshops for reading Instruction but later were eager to spend 
time reading. Many teachers attributed this to the "success experiences" 
In the art workshops which they saw as enccfuraging the students to at-^ 
tempt more difficult tasks. 

Increased positive socialization was also cited as a result of the 
art workshops with many teachers ranarking that students helped an^^ 
praised each other inuch more than usual. In addition, teachers poted 
a high level of motivation, greater confidence, and relative absence 
of behavior prob' ems. • ' . 
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III. Ql||iNTnAT|^^ EVALUATION 



Data were reported for a total of 2,4§9 students^*; served at 20A3&ites 
throughout the city. 'Of these, 218 (3^9 percent)'4#e sporadic or^ low at- 



tenders, 100 (4.1 percent) vifffee discharged: early, and 59 (2.4fepercent) ^ 

were late' admissions. ' tdmplete achievement data were reported .for 2,073 

\ (84.fftrcent). / ' . . ,^ . ■•• 

Most of the students (1,986 or 80.8 percent)^^p;'^i n elementary schools; 

303 (12.3 percent) were in f ntermgidi^ate schools? ^«na. 86'^ (^3*5 perceV 

. ' ^^^^^^ 

were in secondary scboqli.^ \ Fx)r an ?^^t]h9S'M 

/not reparted^ The average age was 10;6Vears ara^'nie mbijj^'^|a^^^^^ ^ 

^ The program included students fr^^ vaniB^, of .di?^[nj||t?groups,^/^ 
with the largest number. XI, 031 of* 41r9. plre;ea,t) -cllssifteI^:nSjrolog-^# 
ically imp^aired and served in. Health conservation 30 cl^^^mWm^SpTn^:. 
cipal disability groMps'were^educable menfcaUy ¥0¥#decl ttil^^^.S |)er-iv 



cent); emotionally handicapped (349 or 14.2 percent); neurtfl&gically irti- ^ 
paired and emotionally handicapped (277 or 11.3 percept);^^^ specific . 
learning clisabled (112 or 4.5 percent). \. 

ATTENDANCE ^ ^ ^^^^ 

The majority of students (1,355 or 55 percent) attended from 20^:to; 
ZS sessions; a total of 25 s€Ssioirs were offered. The mean was 20* 1 and 
the mode was 25» Overall. ^\|^a*ge percent; attendance was 77. 4 ; for students 
with complete data* .average percent attendance was 84.5. 



PUPIL ACHIEVEMENT IN READING 

Mastery of reading skills by program students was measured by the 
Fountain ValTey^ an individually-^^^inlstered criterion-referenced read- 
ing test« The objective proposed that by August 7, 1981, 75 percent of 
the Students who attended at least 50 percent of the sessions would 
have mastered one reading objective. ' 

An inspection of Table 1, .wfiich presents the frequency distribution 

■• ■' * ■■• , ■ ' ■'•■*.":■•■■•.'-■••. ^y- ' ' ' ■ ■ ' ., ' f ■ ^- . 

. ■ . . ■ . . ■ • ♦ ■ ■ ^ : ■ . ■ - ; ■ . " v ■ ■ - . ■. , ■ . -■ . . -. • ■ ■. 

of total . reading skil ls mastered by aV^'students for whom, complete data 
were available, shows tKat 91.9 percent mastered at legist one new objec- 

. tive. The mean number of Skills was Z-OS and the mode was two. A second 
frequency/distribution was prepared for those students v/ho attended at 
.least 60 percent, or 15 out of 25, of the scheduled sessions, ^hese data;, 
whiefi are jpresented^^^^^^^ 2, showed that 92.2 percent of the students 

mastered at least one new skil l; average number was 2*05 and the mode 
was two* Thus, the objective of one new skill was met, with and without 
the qualification of 60-percent attendance. These results represent an 
improvement over the previous year's results during which 84 percent of 
participating students met the objective. 

The vast majority. of^ skills learned were in comprehension, with 81.1 
< percent of all students for whom complete data" were reported mastering at 
least one comprehension objective. A small number of students (17.5 per- 
cent) mastered vocabulary obj^fCtives and aVery few (2.4 percent) learned 
phonics skills. ■ < 

. Students genetrally mastered most of the skills they attempted; in 
most cases, two skills were learned out of the two or three that were 
assessed, for an average percent mastery of 70.9. * 



ifSv^- ■ ' ■. - 
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FREQUENCY DISTRIBUTION OF 
TOTAL READING SKILLS MASTERED 
BY ALL PARTICIPATING STUDENTS 
(N= •2.073) 






M^umber of " 
Skills Mastered ■ 


Number of Relative Percent 
Students „ of Population 


' Cumul ative Percent ,. ^ 
of Populatiori ■ . 


f>-- ■ ■ . . ■ 






■7- 7: ■■■■-,■>.■.■■.■■ :0-.--5v- ' -■■•7 


'•h • •' ' ■ ■ 


"■■;y. 7,;. ^ ■ ^ 


;..,8'v,'. / . /:-.bi4;:7 


■ 7-" - '. ;" . 0; 4 7 ■•" 


■iv' - ■■ • ■ 
f' " ■■ 




17 \ 0.8 


^ ../ ■ .■7-''--l-'7 ..'7' ■;.:-y7,; :\v.-^-' 






61. ■ '■2.9::r:/:fi-t 


. ^-^^ ' ■^■••'^^"r.:7''^'-' . 






142 . 6.8 


' ' : 11.4. : ' " - 






372 ; 17.9 


^: ■ 7';;.:. 29.-3; ■.. " . 


•' 




688 33*2 


.v7:- .7'^ " 62.5 . . ■ . ■': ] 




■■■■ ■ - ^ - ■ 


V ; ■■■609-'' ■ ^ .,,29.4:. 7: . 


: . 91.9'' ' ■ : ': , 






. " 166 ; ■■ 8.0 


99.9^ : . t 




; ^ Does not sum to 100 percent due to roundi n^/ error. 




■;■ 

. • 

ft:/-.:-"'- ■ ■ 


VAlmost 92 percent of the particip^tthg 
one new reading ski 1 1 and 62.5 percent ^mastered two or more. , 

'•' , " , ■ . • i* V: • 

■. ' ■ • ■ ' , ' '''h 

, ■ ' -jK 
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TABLE 2 » 



FREQUENCY DISTRIBUTION OF TOTAL READING SKILLS 
MASTERED BY STUDENTS WHO ATTENDED 
V 60 PERCENT OF SCHEDULED SESSIONS 
(N = 1.940) 



Number of 
Skills Mastered 

. 8 ■ 

7 

6 . 
5 

, 4 

. ., 3 .- . 
. / 2 ' 

TV- ■ 



Number of 
Students 

,10 

«8 

- -16 
59. 
132 
353 

:::;:-64i8;/^' 

563:*-:> 
151 



Relative Percent 
of Population 

0.5 

0.4 

. o.a 

3.0 
6.8 
• 18.2 
/ ,: 33.4/ ;-;;:-:: ; ^ 

::- :-^-29i0::-- 
7.8 



Cumulative Percent 
of Population 

0.5 

0.9 

1.7 ' 

4.7 
11.5 
29.7 
63.1 ■ 
92.2 
100.0 ' 



•More than 92 percent of the students who attended;, a^^^^^^ 15 of 

J the 25 scheduled sessions mastered at least one new readi ng sk11:|: v. 
and over 63 percent mastered two or more. 



, ,.IVV CONCLUSIONS AND 

Results of the quantitative and qualitative assessment of the 1981 
summer UT.R.T.A. program indicated that the program was highly effec- 
tive in meeting its proposed goals. Nearly al 1 (91.9 percent) of the 
program participants mastered at least one new ski 11 in r^adi^ anci many; 
:^(62*5 percent) 1^ or more. Despite some start-up 41 

and significant problems with tr^nsportationv attendance was excel 1 ent; 
students were cooperative and eager to learn. Both reading and ar^ teachers 
were'^errthusiastic about the program and cited gains made byv^tucfents in 
self-confidence, socialization, and creative expression, as well al their 
measur^ed improvement in reading skills. \ 
^Ouring the 1981 cycle, the program was seen to have made improv^- 
ments in a number of areas that were cited as problems in previous y^ars. 
These arid also the ditj^cult which remained were largely admlnist^ra- 
tive in hal^ fopowing were a^^ the areas in which significant 

improvemdi# took place:^ ^ 



-- integration of the reading and arts componentsv 
-- involvement by site supervfsors; and 
adequate and timely provision of supplies. 

However, there were several problems which apparently int erf e^ with 

- " ■ ■ ' " " •-,-11 . ' . ' - • . . ^ / t 

optimal implementation. Chief among these was transportation. There 



^ong these was transportation. .1 
were widespread complaints about scheduling and p^ck-up of studefits 



Other problems cited by many of the respondents were the delays in hiring 
and assignment of teachers* The bilingual component, as a whole, seemed ^ 
to suffer from administrative difficulties whtch were manifesrt^d in the 



following ways: seemingly erratic staff assignment; delays in- distribu- 
tion df testing materials; and, perhaps most problematic, selection of - 
participating students on the basis of their having" Spanish surnames as 
qppps^ to their language prof ici ency . 

$ased oh the f i ndi ngs wh i ch have been prese^hted , t he fol 1 owi ng recom* 

mendations are offered: 

— transportation is a cri-tical problem which could per- 
haps be alleviated by the establi sihment of bus routes 
v^^. : ; / ^ • and the use of trial runs prior to the program; 

-- the program should give consideration to the use of 
I.E.P.S both 1*0 r facilitating the setting -o^^ 
tives and also for giving summer/ teachers informa- 
tion about skills already learneld which can be re- 



inforced; 



— if the program is to include a bilingual 'c.omponent 
attention should be g'iven to mqre^fective se- 
lection and assignment of partjcipafting staff and 
students, specifically, students could b4 selectied 
on the basis of records of thmr pdrticiifatipn in . 
bilingual programs through the schobl ye 

In conclusion* it must be reiterated that ih'e L.r.R.T.Av program was 
highly.successful . in promoting the cognitive and affective development 
of handicapped children and it should be-continued \and expanded to 1n- 
' elude all handicapped children whom it can benefits yt^^^^^ few weaknesses 
that exist appear to be amenable to solution. 



